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Execution of Multidisciplinary Design Optimization 
Approaches on Common Test Problems 


R. J. Balling* and C. A. Wilkinson 1 
Brigham Young University, Provo , Utah 84602-4081 

A class of synthetic problems for testing multidisciplinary design optimization (MDO) approaches is presented. 
These test problems are easy to reproduce because all functions are given as closed-form mathematical expressions. 
They axe constructed in such a way that the optimal value of all variables and the objective is unity. The test problems 
involve three disciplines and allow the user to specify the number of design variables, state variables, coupling func- 
tions, design constraints, controlling design constraints, and the strength of coupling. Several MDO approaches 
were executed on two sample synthetic test problems. These approaches included single-level optimization ap- 
proaches, collaborative optimization approaches, and concurrent subspace optimization approaches. Execution 
results are presented, and the robustness and efficiency of these approaches are evaluated for these sample problems. 
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Nomenclature 

= coupling factor between disciplines 
= coupling factor for disciplinary state 
equations 

= disciplinary analyzers 
= exponents 


= constants 

= Young’s modulus for cantilever beam 
= disciplinary evaluators 
= coefficients 

= system objective function 
= disciplinary objective functions 
= disciplinary objective variables 
= disciplinary design functions 
= disciplinary state functions 
= cantilever beam length 
= number of objective functions in each 
discipline 

= number of design constraints in each 
discipline 

= number of controlling design constraints 
in each discipline 

= number of state equations in each 
discipline 

= number of functions in each discipline 
= number of variables in each discipline 
= number of design variables in each 
discipline 

= number of system design variables 
= number of coupling functions from one 
discipline to another 
= disciplinary optimizers 
= cantilever beam load 
= disciplinary functions 
= disciplinary discrepancy functions 
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rl 

= dummy disciplinary discrepancy variable 

5A 

= system analyzer 

SO 

= system optimizer 

vl, v2 , v3 € R nv 

= disciplinary variables 

x ]t x 2 

■ = variables 

X€R uj 

= system design variables 

X € R n *' 

= dummy system design variables 

xl,x2,x3 € R w 

= disciplinary design variables 

yl2,yl3,y21,y23. 

= coupling functions 

y31,y32 € R** 
yl2J13J21,y23, 

= coupling variables 

jJ31 J32 € R ny 
y21J3l € R ny 

= dummy coupling variables 

zl, z2, z3 € R nh 

= disciplinary state variables 

8 

= allowable deflection for cantilever beam 

X 

= Lagrange multiplier 

a 

= allowable normal stress for cantilever 

X 

beam 

= allowable shear stress for cantilever beam 


Introduction 

M ULTIDISCIPLINARY design optimization (MDO) is a de- 
veloping field of study that is concerned with how to opti- 
mally design and analyze systems composed of multiple disciplinary 
models that are coupled. Usually the design of such complex sys- 
tems is performed by a team that is subdivided into groups associated 
with the disciplines. The disciplines in the system may correspond 
to fields of study (aerodynamics, structures, thermodynamics), or 
they may correspond to physical parts (wing, fuselage, engines). 
One goal of MDO is to allow the disciplinary groups to analyze and 
design in parallel with a certain degree of autonomy. Nevertheless, 
because the disciplines are coupled, their work must be coordinated 
at the system level so that an overall optimum d esign c an be achieved 
for the system. 

Several approaches for formulating and solving MDO problems 
have appeared in the last decade. Many of these approaches can 
be categorized into three groups. The first group consists of single- 
level optimization approaches. 1-4 In these approaches, optimization 
is performed only at the system level, and the role of the disciplines 
is limited to analysis and function evaluation. The second group 
consists of collaborative optimization approaches, 5,6 and the third 
group consists of concurrent subspace optimization approaches. 7-10 
In these latter two groups, optimization is performed at the system 
level as well as within the disciplines. A major difference between 
concurrent subspace optimization and collaborative optimization is 
that in concurrent subspace optimization, each discipline attempts 
to satisfy its own constraints as well as approximations to the con- 
straints of the other disciplines, whereas in collaborative optimiza- 
tion, each discipline satisfies its own constraints and tries to match 
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target values on coupling functions that are needed by other disci- 
plines in the evaluation of their constraints. 

The robustness and efficiency of the various approaches are not 
well understood. It is difficult to obtain good MDO test problems. 
Realistic test problems often involve cumbersome disciplinary soft- 
ware packages. This makes such test problems difficult to reproduce. 
Furthermore, results may be strongly influenced by interfacing de- 
tails and the internal programming characteristics of the disciplinary 
analyses, and thus the inherent behavior of the MDO approach may 
be clouded. 

Another deficiency in many MDO test problems is the lack of 
completeness. The number of disciplines or the numbers of differ- 
ent types of variables and functions in the disciplines may be small. 
Disciplinary models may be linear or otherwise trivial. The coupling 
between disciplines may be weak or incomplete. Results from the 
execution of MDO approaches on incomplete test problems may not 
be indicative of the results that can be expected on more challenging 
problems. 

In this paper, a class of synthetic MDO test problems will be 
presented, and several MDO approaches will be executed on two 
common test problems. The synthetic test problems possess the 
following desirable characteristics. 

1) They are easy to reproduce because all functions are given as 
closed-form mathematical expressions. 

2) They are constructed in such a way that the optimal value of all 
variables and the objective is unity. The feasible region is convex, 
and this optimum is unique. 

3) There are three disciplines, although the concepts presented 
can be extended to create synthetic test problems with more than 
three disciplines. 

4) The completeness is controlled by the user by specifying the 
numbers of design variables, state variables, coupling functions, 
design constraints, and controlling design constraints. 

5) Coupling between disciplines is complete, and the strength of 
the coupling is controlled by the user. 

6) The functions are nonlinear and distinct; however, exact solu- 
tion of the state and coupling equations is possible. 

Sample Elements of an MDO Problem 

We now define some of the elements of an MDO problem. We will 
refer to the three-discipline system shown in Fig. 1. We assume that 
all analytical models in the system are assigned to disciplines. The 
disciplinary models have inputs and outputs. All inputs and outputs 
shown in Fig. 1 are vectors and are defined in the Nomenclature. 
We assume that the optimization problem to be solved is defined as 
follows. 

1) Disciplinary state equations must be satisfied: hi = 0, hi = 0, 
and A3 = 0. These equations may be equations of equilibrium, com- 
patibility, constitution, conservation, etc., based on the physical 
model for the discipline. Note that the number of disciplinary state 
variables is assumed to be equal to the number of disciplinary state 
functions. This implies that the state equations for each discipline 
can be used to solve for the values of the state variables (all other 
variables being held constant). 

2) Disciplinary design constraints must be satisfied: gl < 0, 
g2 < 0, and g3 < 0. These constraints distinguish acceptable/fea- 
sible designs from unacceptable/failed designs. 

3) The system objective function must be minimized: minimize 
/ = /(/l,/2,/3). Note that the system objective is a scalar func- 
tion of the disciplinary objective functions. 
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z2,x2 


z3,x3 
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h2,g2,f2 
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4) Coupling equations must be satisfied: yl2 = yl2, yl3 = y!3, 
y2l = y21, y23 = y23, y31 = y31, and y32 = y32. There is 
a coupling variable associated with each coupling function. These 
coupling variables make it possible to evaluate disciplinary models 
in parallel in a coupled system. The disciplines use assumed values 
of coupling variable! aslrtput to the disciplinary models and evaluate 
their output, which includes the coupling functions. 

Synthetic Test Problems 

Figure 2 plots curves for the equation xfx% — 1 = 0 for various 
negative values of the exponents a and b. We propose synthetic 
design constraints of the form g — xf x\ - C < 0 with a < 0, 
b < 0, and C > 1. The feasible region for such constraints is 
convex, and the point x\ = x 2 * 1 is feasible. We take C = 1 for 
the constraints that control at the optimum and we take C > 1 for 
the constraints that do not control at the optimum. 

Consider a structural optimization problem consisting of a can- 
tilever beam of length L with a transverse load P at the free end. 
The cross section is rectangular and the design variables x { and x 2 
are, respectively, the section width and depth. If the allowable val- 
ues for deflection, normal stress, and shear stress are 5, a, and r, 
respectively, then the constraints are as follows. 

Deflection: 

gx = (4 PL 3 /E)x;'x? -&<o 

Normal stress: 

gi = 6 PLxi l X 2 2 — cr < 0 ( 1 ) 

Shear stress: 

gi = (3/72)*rV - r < 0 

Thus, we see that the proposed synthetic constraints resemble the 
form of constraints that may be encountered in structural optimiza- 
tion. 

We now give formulas for the design functions in our synthetic test 
problems. First, we define the vector of variables vl for discipline 1 . 
The size of this vector is nv = nxs + nx + nh + 2 ny. The vector 
vl contains the values of the input variables for discipline 1 in the 
following order x, xl, zl, y21, y31. In the following formula for the 
design functions of discipline 1, the subscripts i or j to the right of 
a vector indicate the ith or jth element of the vector: 

*1, = n^i,)" 1 " - ci. (2) 

y-i 

We take Cl, = 1 for i < ngc , and we take Cl; = 1.2 for ngc < 
i < ng. We randomly generate values in the interval (-5, 0) for 
each of the exponents a 1, ; *. Similar formulas can be constructed for 
the design functions for disciplines 2 and 3. 

We formally define the state functions in similar fashion. For 
discipline 1, 

nv 

Aii = n< v, j) M " - 1 (3) 


*2 



Fig. 1 Coupled system with three disciplines. 


Fig. 2 Curves of the equation — 1 = 0. 




180 


BALLING AND WILKINSON 


Note that the state equations hi = 0 will be satisfied when all design, 
state, and coupling variables are equal to 1 regardless of whether the 
exponents are positive or negative. We have chosen to use positive 
exponents for state functions. However, if the exponents are too 
large, the magnitude of the state functions could blow up. This can 
be prevented by linking the size of the interval from which exponents 
are randomly generated to the number of variables in the product. For 
the state function Al, , the exponents for the variables are determined 
as follows. 


Variable: 


Exponent b 1,,: 


x,,xl, v 21 . J31/ random from interval ( 0 , - — — ) 

J ’ J J J J \ nxs + nx + 2ny J 


random from interval 
1 


(o-^) 


Zlj j 7* * 

zlj j = i 

The term A^ is a user-specified factor that controls the strength of 
coupling in the state equations. If A itut = 0, the ith state function 
is a function of the ith state variable only and not of the other state 
variables. If A swc > 0, then each state function is coupled to all of 
the state variables. 

We formally define the coupling functions in similar fashion. For 
the coupling functions evaluated in discipline 1 , 

nv nv 

7 12 , = n(vl,)-' 713. = no*/)' 1 " < 4 > 




}=\ 


Variable: 

Exponent c 1 ,; and d 1 : 

X ; , xl ; , Zl j 

random from interval ( 0 , , , ) 

\ nxs + nx + nh J 

721, J31/ 

random from interval ( 0 , ‘^ c ° up ) 

V 2*7 J 



ngc nh ny 

E fl l y + E M <> + £ c1 ' 


el j = -3A < 

j = i i = l i = 1 

ngc nh ny 

E«i, 7 +Em,+E c1 

.1 = 1 1 = 1 i=l 

. . _ . . 

j : -_ri± 

r - j l-e 


j ( v/i + V/2 4 - V/3) 




' ngc ngc ngc nh 

E + E + E v * 3 < + E VA1 > 

i = t 1 = 1 i — I i-t 

+ £ VA2, + VA3, + E V(>12 -712),- 

1 = 1 1=1 i = 1 

+ £v(7l3 -7l3)i + 53 V(721 -y21), 

/ = 1 i = 1 

+ £ V(y23 —y23)t + £ v (^ 31 -7 3 D< 

1 = 1 

+ E V (732 — 732), 


i = l 


= 0 


(7) 

Note that we have assumed that the values of all nontrivial Lagrange 
multipliers are equal to the positive scalar value X y which is yet to 
be determined. In the preceding equation, V/l is the gradient of / 1 
with respect to all design, state, and coupling variables in the system, 
and Vgl, is the gradient of the ith element of gl with respect to all 
design, state, and coupling variables in the system. The preceding 
optimality equation is satisfied if optimality equations are satisfied 
for each discipline. For discipline 1 the optimality equation is 


. r ngc nh ny 

-v/i+J £ v*i f + + E v > 12 ‘ 

J |_| = I 1 = 1 i = l 

ny ny ny 

+ E Yyi3j - £ vy2h - E v 7 31 - 


= 0 


(8) 


In the preceding equation, the gradients are with respect to vl. Eval- 
uating the gradients of Eqs. (2-6) at vl = 1, the disciplinary opti- 
mality equation leads to formulas for the coefficients el; in terms 
of exponents a 1 ,;, M /; , cl,;, and d 1 : 


ny 


, + ^dl ij for j < nxs + nx + nh 

i = l 

rty : . 

i <il,; — 1 for j > nxs 4 - nx -f nh 


(9) 


1 = L. 


The term A*,^ is a user-specified factor that controls the strength of 
coupling between disciplines. Note that if A ^ p = 0, the coupling 
functions in one discipline are not functions of the coupling variables 
from the other disciplines. 


Similar formulas are developed for disciplines 2 and 3. The require- 
ment that the system objective have a value of unity at the optimum 
leads to the following equation for determining the Lagrange muL 
tipllen 


1 X 

f -7 E<^ + e2 i + = 2 

nil 

~ ngc nh 

^^(fll ij + &2 ^ + a3ij) + ^^(^1»; + blij + b3jj) 


6*y ~E 

i=i i=i 

ny 


0 j = i i 

; = i 

+ ^(chj + clij + c3;; + dljj -}- dlij + d3 ij ) 
1 = 1 



We assume that there is a single objective function for each disci- 
pline, and we define the system objective function to be the average 
of the disciplinary objective functions: 

/=I(/l + /2 + /3) (5) 

We employ a quadratic form for the disciplinary objective functions. 
Thus, for discipline 1 » 

(6) 

The coefficients el j are determined such that the point where all de- 
sign, state, and coupling variables are equal to unity is the optimum. 
Therefore, the Kuhn-Tucker conditions require that at the optimum 


The value of the Lagrange multiplier computed from the preceding 
formula should be checked for positivity. 

Implementation 

Implementation of the synthetic test problems involves an initial- 
ization subroutine that reads from the user the following numbers 
and factors: nxs y nx , nh , ny, ng , ngc , A^, and Aco Up . The initializa- 
tion subroutine then calls a random number generation subroutine to 
get the exponents for the three disciplines a 1 ,-; , b 1 , cl;;, d l,y, alij , 
b2 tJ , clij , dl X j , a3 u , b3,j , c3, 7 , and d3 u as described in the previous 
section. Finally, the initialization subroutine computes the Lagrange 
multiplier from Eq. (10) and the coefficients el;, e2;, and e3; for 
the objective functions according to Eq. (9). These coefficients and 
exponents are stored. 
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Implementation also includes an evaluation subroutine for each of 
the three disciplines. We define the vector of functions pi for disci- 
pline 1 . The size of this vector isnp = ng+nh+ 2 ny + 1 . The vector 
pi contains the values of the output functions for discipline 1 in the 
following order gl, Jrl,yl2,y 13, / 1 . The evaluation subroutine for 
discipline 1 receives the argument vl and returns the argument pi. 
The functions are computed according to Eqs. (2 — 4) and (6). 

Explicit gradient evaluation subroutines can also be written for 
each discipline. The gradient evaluation subroutine for discipline 
1 receives the argument vl and returns the arguments pi and Vpl 
where Vpl is the matrix of derivatives of the elements of pi with 
respect to the elements of vl. Equations (2-A) and (6) are easily 
differentiated in closed form: 

n r i _ &hj(gh + Cl ,-) _ blijifili + 1) 

g h ~ Vl; ^ - rtj 

VyUij = sMB. v ,i3 , = on 

v h vl j 

Vflj = eljvlj 

Single-Level Optimization Approaches 

Six single-level optimization approaches were executed on syn- 
thetic MDO problems in the study. The first approach has been 
called the all-at-once approach 11 or the simultaneous analysis and 
design approach. 12 Using the notation introduced in Ref. 13, the first 
approach is 


Given: 


Find: 


Satisfy: 


Return: 


x, xl t y21,y31 


zl 


fcl = 0 


gl,yl2,yl3,/l 

In this study, the disciplinary analyzers employed a Newton iter- 
ation algorithm to solve the state equations. The disciplinary ana- 
lyzers were also modified to explicitly calculate gradients. It might 
be pointed out that it is possible to construct a direct rather than 
iterative disciplinary analyzer by taking the log of Eq. (3) to get a 
set of linear equations that can be solved directly for the logs of 
the state variables. Because direct disciplinary analyzers do not call 
disciplinary evaluators, the notation for such an approach would be 
SO[A\ |A2 [| A3]. 

The third single-level optimization approach in the study has been 
called the multidiscipline feasible approach. 11 The notation for this 
approach is 

SO[SAlA\[E\) |I A2[E2] || A3[£3]]] 


SO[E 1|| E2 1| £3] 

The disciplinary evaluator calls the evaluation subroutine for the 
discipline. Thus, the disciplinary evaluator for discipline 1 performs 
the following task. 

Given: 

x,xl,zl,y21J31 


The system optimizer solves the same optimization problem as in 
the all-at-once approach except that the state variables, coupling 
variables, state equations, and coupling equations are eliminated. 
The system analyzer solves the coupling equations for the values of 
the coupling variables. Specifically, it solves the following problem. 

Given: 

x, xl, x2, x3 


Return: 


gl,M,yl2,yl3,/l 


The symbol || indicates that the disciplinary evaluators are executed 
in parallel. A sequential quadratic programming (SQP) algorithm 14 
was used as the system optimizer for all six single-level optimization 
approaches in the study. The symbol [ • • •] indicates nested execu- 
tion meaning that the evaluation subroutines are executed at each 
iteration of the system optimizer. The optimization problem solved 
by the system optimizer in the all-at-once approach is as follows. 

Find: 

x, xl, x2,x3, zl, z2, z3, j?12 J13 J21 J23,y31,y32 


Minimize: 


Satisfy: 


/1+/2 + /3 
3 


< 0 g2<0 g3 < 0 design constraints 


hi = 0 hi = 0 h3 = 0 state equations 
yl2 = yll yl3 = y!3 yll — y21 coupling equations 

y23 = y23 y31 = y31 y32 = y32 coupling equations 

The second single-level optimization approach in the study has 
been called the individual discipline feasible approach 11 or the 
nested analysis and design approach. 13 The notation for this ap- 
proach is 


Find: 


yl2, yl3, y21, y23, y31 , y32 


Satisfy: 

y!2 = y!2 yl3 = y!3 yll = yll 

y23 = yl3 y31 = y31 y32 = y32 

Return: 

gl,g2,g3,/l,/2,/3 

Two iterative system analyzers are possible. The first is a fixed-point 
iteration algorithm in which the computed values of the coupling 
functions at any iteration are used as the assumed values for the 
coupling variables in the next iteration. The second is a gradient- 
based Newton iteration algorithm that converges in slightly fewer 
iterations than fixed-point iteration. The Newton iteration algorithm 
was used in the study. The system analyzer was modified to explic- 
itly calculate gradients based on the global sensitivity equations. 15 
It is possible to construct a direct rather than iterative system an- 
alyzer by taking the log of Eq. (4) to get a set of linear equations 
that can be solved directly for the logs of the coupling variables. 
Because the direct system analyzer does not call disciplinary an- 
alyzers or evaluators, the notation for such an approach would be 
SO[SA]. 

The fourth single-level optimization approach in the study is also 
a multidiscipline feasible approach like the previous approach. The 
difference between the approaches is evident from the notation for 
the fourth approach: 


S0[A1[E1] || A2[£2] || A3[£3]] 


SO[SA[A\[El] A2[E2) A3[£3]]] 


The system optimizer solves the same optimization problem as in 
the all-at-once approach except that the state variables and state 
equations are eliminated. The role of Al, A2, and A3 is to solve the 
state equations for the state variables in each discipline. Thus, the 
disciplinary analyzer for discipline 1 solves the following problem. 


The symbol — ► indicates serial execution of the disciplinary ana- 
lyzers. Because Al is executed before A2 and A3, there is no need 
for coupling variables yll and y 13 because the coupling functions 
jl2 and yl3 could be sent directly from Al to A2 and A3. Sim- 
ilarly, there is no need for coupling variables j>23 because A2 is 
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executed before A3. Thus, these coupling variables and their corre- 
sponding coupling equations are deleted from the problem solved 
by the system analyzer in this approach. 

The fifth single-level optimization approach in the study is also a 
multidiscipline feasible approach like die previous two approaches. 
However, the notation for the fifth approach is different: 


Return: 

rl 

In this formulation, the evaluator for discipline 1 performs the fol- 
lowing task. 

Given: 


SA[A1[E1] || A2[E2] || A3[E3]] 

4 * SO[A\[E\) 0 A2[E2] H A3[E3]] 

The symbol +> indicates alternating execution of the system ana- 
lyzer and the system optimizer. This means that the design variables 
are held constant while the system analyzer solves for the coupling 
variables, and the coupling variables are held constant while the 
system optimizer solves for the design variables. This process is 
repeated for a specified number of cycles. 

The sixth single-level optimization approach in the study is also 
a multidiscipline feasible approach and has the same notation as 
the fifth approach. It is identical to the fifth approach with one 
exception: the coupling variables are not held constant during system 
optimization, but rather they are approximated as linear functions 
of the design variables based on values of derivatives provided by 
the system analyzer. 

Collaborative Optimization Approaches 

The collaborative optimization approaches that were considered 
in the study are all described by the following notation: 

SO[Ol[E\] || G2[E2] || 03[E3]] 

This implies that in collaborative optimization, disciplines are per- 
mitted to design as well as analyze. The problem solved by the 
system optimizer in collaborative optimization is as follows. 

Find: 

xJ12J13J21,y23, jF31, J32, fh /2, /3 

Minimize: 

/1 + /2 + /3 
3 

Satisfy: 

rl < 0 r2 < 0 r3 < 0 
The role of system optimization is the determination of system de- 
sign variables, coupling vari ables^bet ween disciplines, and the disci- 
plinary objective variables, / 1 , /2, / 3, which serve as target values 
on the objective functions for each of the disciplines. The system 
receives only a single scalar function back from each discipline. We 
will call these functions (r 1 , r2, r 3) discrepancy functions. They are 
a measure of how successful the disciplines were in solving their 
optimization problems. A value of zero indicates complete success, 
whereas a positive value indicates that success was incomplete. 

Three formulations for the disciplinary optimization problem 
were considered in the study. In formulation 1 , the optimizer for 
discipline 1 solves the following problem. 

Given: 

X,y21,y31,yl2,yl3, /l 


Find: 


xl,zl,x,y21,y31 


Minimize: 



x,xl,zl,y21,y31 

Return: 


gl,ftl,yl2,yl3,/l 

If one carefully studies the preceding, one recognizes that in for- 
mulation 1 discipline 1 satisfies its own design constraints and state 
equations and does its best to match the dummy input variables 
to the evaluator (x,y21,y31) with system targets (x,y21,y31) and 
to match output functions from the evaluator (yl2,yl3, / 1) with 
system targets (yl2,^13, /l). An / 2 (Euclidean) metric is used to 
quantify the success in matching the target values. 

In formulation 2 of collaborative optimization, the optimizer for 
discipline 1 solves the following problem. 

Given: 

x, y21, y31, y 12, y 13, /l 

Find: 

xl,zl,x,y21,y31, rl 

Minimize: 

rl = rl 

Satisfy: 

gl < 0 hi = 0 

Iyl2, — >12/1 < rl |yl3; -yl3 f | < rl 1/1 = /l| < rl 
\Xi Xj | < rl |y21, -y21/I < rl |y31< -y3l,| < rl 


Return: 


rl 


The evaluator for discipline I performs the same task as in for- 
mulation 1. Note that in formulation 2 the l 0 0 (max) metric of the 
mismatches with the system targets is minimized rather than the / 2 
metric. This is accomplished by minimizing the dummy variable 
rl, which is constrained to be greater than all mismatches. This is 
the only difference between formulations 1 and 2. 

In formulation 3 of collaborative optimization, the optimizer for 
discipline 1 solves the following problem. 

Given: 

X,y21,y31,yl2,yl3,/l 

Find: 


xl,zl>x, rl 


Minimize: 


rl = F1 


Satisfy: 


gl, <rl \hh\Sr\ 


\yl2i -yl2i \ < rl |yl3/ -yl3,| < rl |/1 = /l| < rl 
Return: 


rl 

In this formulation, the evaluator for discipline 1 performs the fol- 
lowing task. 

Given: 

x, xl,zl,y21,y31 


Satisfy: 


gl<0 


hi <0 


Return: 


*l,Al,yl2,yl3,/l 


BALLING AND WILKINSON 


183 


Note that in this formulation the input variables to the evaluator are 
the system targets so that there are no mismatches on the inputs. 
The loo metric of the mismatches of the outputs and of the violation 
in design constraints and state equations is minimized. 

Summarizing these collaborative optimization formulations, the 
disciplinary optimizers seek disciplinary design and state variables 
that satisfy three goals; 1) match target inputs to the disciplinary 
model, 2) match target outputs from the disciplinary model, and 3) 
satisfy disciplinary design constraints and state equations. In gen- 
eral, it is possible to satisfy completely only one of the three goals 
for all possible target values sent down from the system. In formula- 
tions 1 and 2, the third goal is satisfied completely, whereas a metric 
of the discrepancy in the first two goals is minimized. In formula- 
tion 3, the first goal is satisfied completely, whereas a metric of the 
discrepancy in the last two goals is minimized. In formulation 1, 
the h metric is employed, whereas in formulations 2 and 3, the /<» 
metric is employed. 

In the study, the SQP algorithm was used to solve the disciplinary 
optimization problems for all three formulations. However, the SQP 
algorithm and a cutting plane algorithm 6 were used as system opti- 
mizers for each of the three formulations. The latter algorithm was 
used because the discrepancy functions received from the disciplines 
may be nonsmooth or even discontinuous functions in collaborative 
optimization. 

The beauty of collaborative optimization is that each discipline 
is in control of its own design/state variables/functions and does 
not meddle directly with the design/state variables/functions of the 
other disciplines. The system level does not meddle directly with the 
design/state variables/fimctions of the disciplines, but rather it fo- 
cuses on the system design variables, the coupling variables between 
disciplines, and the allocation of objective responsibility among the 
disciplines. These qualities of collaborative optimization make it 
amenable to existing organizational structures in industry. Further- 
more, these qualities give the disciplines the autonomy to search over 
topologies and concepts, modify their models, and even reformulate 
their variables and functions without disrupting the MDO process. 

Concurrent Subspace Optimization 

Concurrent subspace optimization is formulated for problems 
without system design variables x. As alluded to earlier, this does 
not limit generality because the system design variables could be 
included in the design variables for one of the disciplines, and their 
values could be passed as coupling functions to the other disciplines. 

The concurrent sub space optimization approaches that were con- 
sidered in the study are described by the following notation: 

SA[A\[E\]\\ A2[E2] || A3[E3]] 

<+ Ol[Al[E\]]\\02[A2[E2]] || 03[A3[E3]] 

It is implied that nested execution [• • •] has precedence over parallel 
execution which has precedence over alternating execution **. 
The system analyzer solves the coupling equations for the coupling 
variables with the design variables held fixed. Two formulations 
for the disciplinary optimization problems were considered in the 
study. For both formulations, the SQP algorithm was used to solve 
the disciplinary optimization problems. In the first formulation, the 
optimizer for discipline 1 solves the following problem. 

Find: 

xl 

Minimize: 

/I 

Satisfy: 

gl <0 

In this formulation, linear approximations for coupling variables 
y21 and y$ 1 are used in the evaluation of /I and gl. These ap- 
proximations are based on the values of derivatives with respect to 
xl received from the system analyzer. Note that in this formulation 
each discipline determines its design variables without regard for 
the objectives and constraints in the other disciplines. We will refer 
to this formulation as the selfish linear formulation. It may reach the 
system optimum if the system is uncoupled or weakly coupled. 


In the second formulation, the objectives and constraints from all 
disciplines are considered by each discipline. Thus, the optimizer 
for discipline 1 solves the following problem. 

Find: 


Minimize: 


Satisfy: 


xl 

/1 + /2 + /3 
3 

gl < 0 g2 < 0 


g3< 0 


As was the case in the selfish linear formulation, linear approxima- 
tions for coupling variables y2l and y31 are used in the evaluation 
of / 1 andgl in the preceding formulation. Also, the optimizer for 
discipline 1 calls the analyzer for discipline 1 only and not the ana- 
lyzers for disciplines 2 and 3. Therefore, linear approximations for 
the functions / 2, /3,g2, andg3 are employed based on the values 
of derivatives of these functions with respect to xl received from 
the system analyzer. We will refer to this formulation as the selfless 
linear formulation. 

It is clear that the selfless linear formulation will not always con- 
verge to the system optimum. This is because it may be impossi- 
ble for some disciplines to satisfy the approximate constraints of 
all disciplines. Surely this is the case if the disciplines are uncou- 
pled. Researchers have relaxed the requirement that each discipline 
must completely satisfy the approximate constraints of all disci- 
plines by introducing responsibility fractions, which are determined 
by solving a system optimization problem known as the coordina- 
tion problem. 7 * 10 However, these approaches have not been imple- 
mented in the study. 

Test Results 

Two test problems were considered in the study. They are de- 
scribed by the following parameter values. Specific values for the 
hundreds of exponents randomly generated for these two problems 
can be obtained directly from the authors. Furthermore, these test 
problems are in the process of being placed on the internet under the 
test suite being sponsored by the NASA Langley MDO Branch. 16 

Problem 1 


nxs = 0 
nx = 8 
nh = 0 
ny = 2 
ng = 10 
ngc = 6 

A gue = 1.0 
A coup = 1.0 

Problem 2 


nxs = 2 
nx = 8 
nh = 10 
ny = 2 
ng = 10 
ngc = 6 

A stgc “ 1*0 
Acoup = L0 

All approaches were executed on problem 1, but the concurrent 
subspace optimization approaches were not executed on problem 2 
because it involves system design variables. 

Maximum and minimum values of 5.0 and 0.5, respectively, were 
used for all variables. Starting values of 5.0 were used for all vari- 
ables, although starting values of 0.5 and 2.0 were also tried with 
little change in results. Recall that the optimum values for all vari- 
ables and for the objective are unity. 

An evaluation counter was incremented in each call to the evalua- 
tion subroutine or the gradient evaluation subroutine for discipline 1 . 
We assume that the number of calls to the evaluation subroutines 
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Table 1 Evaluation counts for convergence 


Approach 

Problem 

1 2 

Single-level, all-at-once 
SO[E li| £2 1| £3] 

48/60 

56/65 

Single- level, individual discipline feasible 
SO[A\[E\) 11 A2[E2] j!A3[E3]] 

48/60 

216/240 

Single-level, multidiscipline feasible, nested parallel 
50[SA[A1[£I3 |1 A2[E2] H A3[E3]]) 

Failed 

800/908 

Single-level, multidiscipline feasible, nested serial 
S0[SA[A1[£1] A2[E2] -► A3[£3]]] 

244/268 

684/792 

Single-level, multidiscipline feasible, alternating constant 
SA[A1[E1] ji A2[£2] |j A3[£3]] +* S0[A1[E1] j| A2[£2] || A3[£3J] 

Failed 

430/946 

Single-level, multidiscipline feasible, alternating linear 
5A[A1[£1] || A2[£2] || A3[£3]] 50[A1[£1] 0 A2[£2] || A3[£3J] 

Failed 

378/548 

Collaborative, formulation 1, SQP algorithm 
S0[0\[E\]\\02[E2] || 03[£3]] 

5,501/1,270 

8,240/2,364 

Collaborative, formulation 2, SQP algorithm 
50[01[£1] \\01[E2] || 03[£3]] 

12,580/12,580 

9,534/9,909 

Collaborative, formulation 3, SQP algorithm 
S0[01[£l]||02[£2] || 03[£3]] 

7,744/3,533 

9,064/7,709 

Collaborative, formulation 1, cutting plane algorithm 
S0[0\[E\] || 02[£2] ]] 03[£3J] 

467/1,018 

820/2,354 

Collaborative, formulation 2, cutting plane algorithm 
S0[01[E1] || 02[£2] || 03[£3]] 

802/1,960 

1,085/3,745 

Collaborative, formulation 3, cutting plane algorithm 
S0[01[£l]||02[£2] f| 03[£3]] 

1,443/3,062 

2,399/5,255 

Concurrent subspace, selfish linear 

5A[A1[E1} |I A2[£2] || A3[£3]] 01[A1[£1]] |j 02[A2[£2]] || 03[A3[£3J] 

Failed 

Does not apply 

Concurrent subspace, selfless linear 

SA[A![E1] || A2[£2] H A3[E3]] <+ 01[A1[£1]] || 02[A2[£2]] || 03[A3[E3J] 

Failed 

Does not apply 




Fig. 3 Performance of single-level optimization approaches on problem 2. 
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Fig. 4 Performance of collaborative optimization formulation 1 on problem 2. 


for disciplines 2 and 3 would be roughly the same. Explicit gra- 
dient evaluation was used for all approaches (no finite difference 
gradients). Recall that for those approaches involving disciplinary 
analyzers a Newton method was used to solve the state equations, 
and for those approaches involving a system analyzer, a Newton 
method was used to solve the coupling equations. Newton methods 
were used rather than exact solvers, which would unfairly exploit 
the mathematical form of the synthetic problems and thus bias the 
comparison. Table 1 shows two numbers for each approach for each 
test problem. The left number is the value of the evaluation counter 
when objective reached and stayed within 1 ±0.1, and the right 
number is the value of the evaluation counter when all variables 
reached and stayed within 1 ± 0. 1 . 

A main break point was defined for each approach. The main 
break point for the first four single-level optimization approaches 
and for the collaborative optimization approaches was in the main 
iteration loop of the system optimizer. For the concurrent subspace 
optimization approaches and the last two single-level optimization 
approaches, the main break point was taken at the end of the system 
analyzer. At the main break point for each approach, the following 
three numbers were output: 1) the evaluation counter, 2) the value 
of the system objective, and 3) the maximum error in variables from 
optimal value of unity. The system objective and the maximum error 
in variables are plotted vs evaluation counter in Figs. 3 and 4 for 
problem 2. 

Observations and Conclusions 

Approach robustness seems to depend on the strength of coupling. 
Note in Table 1 which approaches failed at A coup = A ^ te = 1 . When 


the coupling was increased to Acoup = A state = 2, all approaches 
failed except the first two single-level optimization approaches and 
the collaborative optimization approaches. Perhaps these robust ap- 
proaches could solve problems with even higher levels of coupling. 
All approaches succeeded when the coupling was decreased to 
Acoup = A St** = | with the exception of the concurrent subspace self- 
less linear approach. Failure of the single-level multidiscipline fea- 
sible approaches occurred in the Newton system analyzer when neg- 
ative values of the coupling variables were encountered during the 
Newton iterations. The same type of failure was observed in the con- 
current subspace selfish linear approach. Thus, increased coupling 
causes difficulty in approaches involving system analyzers. Failure 
of the concurrent subspace selfless linear approach, even at low lev- 
els of coupling, occurred in the disciplinary optimizers, which were 
unable to find feasible designs. Clearly, this approach is flawed. 

When started from the optimum, all of the single-level and con- 
current subspace optimization approaches recognize optimality af- 
ter gradients are calculated and immediately stop. However, when 
the collaborative optimization approaches are started from the op- 
timum, they send the disciplinary objective variables to their lower 
bounds and work back to the optimum from the infeasible side just 
as if they were started from any other point. At the optimum, the dis- 
crepancy functions and their gradients with respect to the variables 
in the system optimization problem are zero. Since the gradient of 
the objective function is not zero at the optimum, the Kuhn-Tucker 
conditions as typically formulated are not satisfied. It should be 
pointed out that infinitesimally on the infeasible side of the opti- 
mum the gradients of the discrepancy functions are nonzero, and 
the Kuhn-Tbcker conditions can be satisfied. Theoretical work is 
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needed to establish proper optimality conditions for terminating the 
collaborative optimization approaches. 

Defining approach efficiency in terms of number of model eval- 
uations, the single-level optimization approaches are clearly more 
efficient than the collaborative optimization approaches. The rank- 
ing of the single-level optimization approaches can be deduced from 
Fig. 3, where we see that the most efficient approach (all-at-once) 
requires about an order of magnitude fewer evaluations than the least 
efficient approach (multi discipline feasible, nested parallel). The ef- 
ficiency of the collaborative optimization approaches is improved on 
these test problems through the use of the cutting plane algorithm, 
particularly in the convergence of the objective to its optimal value. 
It appears that formulation 1 is the most efficient formulation for 
collaborative optimization, whereas the efficiencies of formulations 
2 and 3 are roughly the same. Formulation 1 is the only formulation 
employing the h metric. It might be noted that when the metric in 
formulation 1 was modified to be the sum of the squares rather than 
the square root of the sum of the squares, its efficiency worsened 
by a factor of 2 when the SQP algorithm was used and by a factor 
of 10 when the cutting plane algorithm was used. When the concur- 
rent subspace selfish linear approach did not fail ( A ^ = |), the 
number of evaluations to convergence was comparable to that of the 
single-level multidiscipline feasible alternating linear approach. 

Since the evaluation counter was incremented in the evaluation 
subroutine for discipline 1 only, the efficiency results would not 
change significantly if parallelism of the disciplines were exploited. 
However, the efficiency results in terms of the evaluation counter 
are not telling the whole story. In the study, the actual execution 
time to convergence for the single-level all-at-once approach was 
about as long as that of the collaborative optimization approaches 
and more than an order of magnitude longer than that of the single- 
level multidiscipline feasible approaches. The reason for this is that 
model evaluation for the synthetic test problems is trivial, and most 
of the execution time was spent in the numerical procedures of the 
optimizers. Since the single-level all-at-once approach solved the 
biggest optimization problem, it required a lot of execution time. It 
is anticipated that in most real-world applications model evaluation 
will be significant rather than trivial. 

Acknowledgments 

The authors gratefully acknowledge support for this work from 
NASA Grant NAG- 1-1694 from NASA Langley Research Center 
and National Science Foundation Grant DMI-9500046. 


References 

Grossman, B., Haftka, R. T., Kao, P.-J., Polen, D. M., Rais-Rohani, 
M., and Sobieszczanski-Sobieski, J., “Integrated Aerodynamic Structural 
Design of a Transport Wing ” AIAA Paper 89-2129, Sept. 1989. 

2 Hajela, P., Bloebaum, C. L., and Sobieszczanski-Sobieski, J., “Applica- 
tion of Global Sensitivity Equations in Multidisciplinary Aircraft Synthesis ," 
Journal of Aircraft, Vol. 27, No. 12, 1990, pp. 1002-1010. 

3 Haftka, R. T., Sobieszczanski-Sobieski, J., and Padula, S. L., “On Op- 
tions for Interdisciplinary Analysis and Design Optimization,” Structural 
Optimization , Vol. 4, No. 2, 1992, pp. 65-74. 

4 Hou, G. W., Taylor, A. C., Mani, S. V., and Newman, P. A., “Formulation 
for Simultaneous Aerodynamic Analysis and Design Optimization ” Second 
U.S. National Congress on Computational Mechanics (Washington, DC), 
Center for Computational Structures Technology, Univ, of Virginia/NASA 
Langley Research Center, Hampton, VA, 1993. 

5 Ktoo, I., Altus, S., Braun, R., Gage, P., and Sobieski, I , “Multidisci- 
plinary Optimization Methods for Aircraft Preliminary Design ” AIAA Pa- 
per 94-4325, Sept 1994. 

6 Balling, R. J., and Sobieszczanski-Sobieski, J., “An Algorithm for Solv- 
ing the System-Level Problem in Multilevel Optimization ” Structural Op- 
timization , Vol. 9, 1995, pp. 168-177. 

7 Sobieszczanski-Sobieski, J., “Optimization by Decomposition: A Step 
from Hierarchic to Non-Hierarchic Systems,” Recent Advances in Multidis- 
ciplinary Analysis and Optimization, NASA CP-3031, Sept. 1988. 

8 Pan, J., and Diaz, A. R., “Some Results in Optimization of 
Non-Hierarchic Systems,” Advances in Design Automation , Publication 
DE-Vol. 1 9-2, American Society of Mechanical Engineers, New York, 1989. 

9 Renaud, J. E., and Gabriele, G. A., improved Coordination in Non- 
hierarchic System Optimization,” AIAA Journal , Vol. 31, No. 12, 1993, pp. 
2367-2373. 

l0 Eason, E., Nystrom, G., Burlingham, A., and Nelson, E,, “Non- 
Hierarchic Multidisciplinary Design of a Commercial Aircraft,” AIAA Pa- 
per 944302, Sept. 1994. 

1 framer, E. J., Dennis, J. E., Jr. t Frank, P. D., Lewis, R. M., and Shubin, 
G. R., “Problem Formulation for Multidisciplinary Optimization,” SIAM 
Journal on Optimization , Vol. 4, No. 4, 1994, pp. 754-776. 

I2 Haftka, R. T., “Simultaneous Analysis and Design,” AIAA Journal , Vol. 
23, No. 7, 1985, pp. 1099-1103. 

13 Balling, R. J., and Sobieszczanski-Sobieski, J., “Optimization of Cou- 
pled Systems: A Critical Overview of Approaches,” AIAA Journal , Vol. 34, 
No. 1, 1996, pp. 6-17. 

14 PoweII, M. J. D„ “Algorithms for Nonlinear Functions That Use La- 
grangian Functions,” Mathematical Programming , Vol. 14, 1978, p. 224. 

15 Sobieszczanski-Sobieski, J., "Sensitivity of Complex, Internally Cou- 
pled Systems,” AIAA Journal , Vol. 28, No. 1, 1990, pp. 153-160. 

16 Padula, S., Alexandrov, N., and Green, L., “MDO Test Suite at NASA 
Langley Research Center” AIAA Paper 96-4028, Sept. 1996. 



